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ABSTRACT 

A study investigated teachers* and staff developers* 
perceptions and assessment of the Whole Language Network (which 
assists teachers in using the whole language approach) , the support 
provided to participants, changes in teaching and assessment 
practices, and the effects of such changes on student attitudes and 
achievement. A total of 164 teachers in 5 Community School Districts 
in the New York City school system participated in the Network during 
1992-93. Results indicated that: (1) almost all teachers reported 
that the Network was valuable in helping them implement whole 
language teaching strategies; (2) a large majority of participants 
found the exploration of alternative assessment trends useful; (3) 
the few respondents who participated in the Shakespeare component 
considered the experience to be valuable for their students; (4) 
nearly all teachers found the monthly meetings and in-school 
assistance provided by staff developers valuable in helping them 
apply whole language concepts in their classrooms; (5) nearly all 
participants described positive changes in their teaching that they 
attributed to their participation in the Network; (6) a majority of 
teachers noted positive changes in students* attitudes toward 
learning; and (7) mean differences in scores of Network and 
non-Network students were too small to be considered educationally 
meaningful. Findings suftgest that project staff should: continue to 
educate teachers about whole language techniques; endeavor to expand 
the Network; secure the interest and active participation of 
principals; explore ways of obtaining books and other materials; and 
explore ways to provide teachers more time to meet together. (Six 
tables of data are included.) (RS) 
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EXECUTIVE SUMMARY 



The Whole Language Network (W.L.N.) was initiated during the 
1989-90 school year in comnunity School District (C.S.D.) 11 with 
a small group of teachers who were participating in the New York 
City Board of Education's Comprehensive Instructional Management 
system*Communication Arts (CIMS-CA) project. During 1991-92, the 
W.L.N, expanded to include 90 teachers in grades kindergarten 
through six in three districts — C.S.D.s 3, 11^ and 30. C.S.D.s 5 
and 15 joined the Network during 1992-93. A total of 164 
teachers participated, including a group of middle school 
teachers in C.S.D. 11 who became involved during the spring 
semester. The purpose of the Network was to assist teachers in 
using the whole language approach, which emphasizes the 
integration of language arts skills (speaking, reading, writing, 
and listening), as well as subject area instruction, through the 
use of unifying themes. The project also sought to empower 
teachers to assume a more active role in curriculum decision- 
making . 

Project activities included monthly workshops, either during 
or after the school day, led by CIMS-CA staff develpers; 
professional development conferences in summer 1992 and May 1993; 
and a drama omponent. Staff developers assisted W.L.N, 
participants in selecting and obtaining materials (particularly 
children's literature) , visited teachers' classrooms to 
demonstrate effective teaching strategies, and worked with 
teachers individually to develop and implement instructional 
themes. A major focus of the project this year was the 
exploration of alternative approaches to assessment. 

The evaluation of the W.L.N, by the Office of Research, 
Evaluation, and Assessment (OREA) during 1992-93 investigated 
teachers' and staff developers' perceptions and assessment of the 
Network, the support provided to participants, changes in 
ti »ching and assessment practices, and the effects of such 
changes on student attitudes and achievement. 

Almost all teachers reported that the W.L.N, was valuable in 
helping them to implement whole language teaching strategies — 
e.g., incorporating children's literature, making the 
reading/%rriting connection, encouraging process inriting, using 
multicultural and interdisciplinary themes, and encouraging 
cooperative learning. A large majority of participants also 
found the exploration of alternative assessment trends 
useful; in some districts, teachers piloted techniques such as 
portfolios, checklists, and interviews with students. 

While relatively few of the respondents participated in the 
Shakespeare component, those who did considered the experience 
valuable for their students, and the related activities— *e.g« , 
pre** and post^play workshops and artists' visits to classroom — 
useful resources for them as teachers. 



Nearly all teachers found the monthly W^L.N. meetings ard 
in-school assistance provided by the staff developers valuable :r. 
helping thea to apply whole language concepts in their 
classrooms; many regarded the support from staff developers and 
colleagues key to their success in implementing whole language 
practices. Valuable, too, were the summer 1992 and spring I9 9i 
conferences. However, while a majority of participants repcrtei 
that principals provided released time for staff development 
activities and encouraged the purchase of appropriate materials, 
school administrators and supervisors were not actively involved 
in supporting Network activities for the most part. 

Nearly all respondents described positive changes in their 
teaching that they attributed to their participation in the 
W.L.N. These included using literature to help children make 
connections to their personal experiences and other subjects, 
providing opportunities for individual choice and independent 
work, and promoting student understanding of the power of 
language through its usage in meaningful contexts* Participants 
also reported that they were more involved in curriculum 
decision-making and open to new ideas, were benefiting from close 
working relationships with their colleagues, and were more 
enthusiastic about teaching, overall. 

A majority of W.L.N, teachers noted positive changes in 
students' attitudes towards learning-^especially a heightened 
interest in reading and writing — and greater confidence in their 
abilities. Most teachers attributed improvements in student 
achievement to the W.L.N. , although others were unsure about such 
a connection. 

Teachers identified a variety of areas in which they 
believed additional support was needed, including increased 
funding for materails, additional time for staff development 
activities and networking with colleagues, opportunities to visit 
and observe other whole language cleiSsrooms, and more assistance 
from school prinicpals and supervisors. Staff developers echoed 
these needs, and also expressed the hope that the Network would 
expand to include more teachers and would cluster more teachers 
in the same schools to promote peer support. 

Overall, the mean differences in the spring 1993 D.R.P. 
scores of W.L.N, and non-W.L.N. students in the sample districts 
were too small to be considered educationally meaningful, 
although in C.S.D.s 11 and 30 there was a tendency for the scores 
of W.L.N, students to be higher than those of non*W.L«N. 
students. In C«S.D. 3 this trend was reversed. 

Based on these evaluation findings, OREA makes the following 
recommendations : 



• CIMS-CA staff developers should continue to educate Network 
teachers about alternative assessment strategies, and assist 
then in implementing these techniques in whole language 
classrooms. These should include the use of language in 
meaningful contexts, demonstrations of competence with a 
variety of genres, and opportunities for students both to 
demonstrate and reflect on their own progress over tine. 

• Given the success the W.L.N, has experienced, CIMS*CA 
program staff should endeavor to expand the number of 
districts and teachers involved in it and, to the extent 
possible, concentrate a larger number of participating 
teachers, and teachers of contiguous grades, in the same 
schools. This would provide teachers with greater sources 
of support and students with greater instructional 
continuity. 

• In view of the importance of principals' support in 
integrating whole language strategies into classroom 
practice, project staff should continue to explore ways of 
securing their interest and active participation. 

• Project staff should continue to explore ways of obtaining 
books and other materials necessary to the whole language 
approach, including private donations; stragegies for 
sharing needed materials, such as district bookmobiles, 
might be considered as well. 

• Together with school and district administrators, W.L.N, 
staff should explore ways to provide Network teachers with 
more time to meet together and to participate in staff 
development activities, both during and after the school 
day. 
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I. INTRODUCTION 



BACKgRQWD 

The goals of the New York City Board of Education's 
Comprehensive Instructional Management System-Communication Arts 
(CIMS-CA) program^ introduced in 1980, are to develop a holistic 
communication arts curriculum and staff development program for 
kindergarten through grade eight. The program emphasizes the 
integration of reading, writing, listening, and speaking skilLs 
using a thematic approach that cuts across subject areas. 
Previous evaluations of this project by the Office of Research, 
Evaluation, and Assessment (OREA) have explored many issues, 
including teachers' use and assessment of the CIMS-CA curriculum, 
the staff development provided, and the impact of the program on 
students' reading and writing achievement. 

Overall, the findings have indicated that teachers consider 
the curriculum to be interesting and motivating for students, and 
particularly useful for integrating language skills. They have 
judged the staff development*-*especially grade and faculty 
conferences, and demonstration lessons — to be helpful. Teachers 
who participated in the drama component, initiated in 1985-86, 
have consistently judged it to be a valuable learning experience 
for their students. CIMS-CA has also generally been associated 
with growth in students' reading and writing achievement. 

Criticism has focused on the level of difficulty for less 
<\ble readers and English as a Second Language (E.S.L.) students, 
the project's failure to update the currlcular themes, and the 



lack of adequate support from school administrators and 
-supervisors. - „ 

During the 1989-90 school year, the project piloted the 
Whole Language Network (W.L.N.) in CS.D. 11 with a small group 
of CIHS-CA teachers. The W,L.N» expanded during 1991-92 to 
include two additional districts, C.S.D.s 3 and 30, and during 
1992-93 to include two more, C.S.D.s 5 and 15. In the 1991-92 
school year a total of 90 teachers in grades K-6 participated in 
this project; in 1992-93 the number rose to 164,* and included a 
group of middle school teachers who joined the project in 
February 1993. 

The purpose of the Network was to assist teachers in 
understanding and using the whole language approach, an 
instructional strategy that is consistent with the holistic 
philosophy of the CIMS-CA curriculum. Accordingly, it encouraged 
teachers to use children's literature as a springboard for 
various curriculum activities, such as %nriting, reading aloud, 
and sharing ideas with classmates, and emphasized the importance 
of authentic learning contexts*- i. e. , instructional and 
assessment activities that engage students in meaningful tasks, 
rather than teach and evaluate isolated skills out of context. 
Another objective of the W.L.N, was to empower teachers to play a 



^During the first two years of the project's operation, teachers 
identified as particularly "effective" by CIMS-CA staff 
developers or by district and school staff were invited to 
participate on a voluntary basis. In subseguent years, the 
project expanded to include teachers, typically less experienced, 
who principals believed would benefit from participation. 
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mora active rol« in curriculum decision-making, including 
clev«lopm«nt of curricular themes and selection of materials, 

Tha currant OREA evaluation focused on this project 
component r in part because it is the most recent CIMS-CA 
initiativa, and in part because its overall approach reflects 
national trends in instruction and assessment, 
Prgjtwt AwtivitiM 

Monthly vorkahopa, CIMS-CA staff developers in the five 
participating districts led monthly workshops for W.L.N, 
participants, although teachers typically set the agenda. In 
ttome districts these workshops were held after school hours; in 
others I teachers were given release time to attend during the 
school day. Sessions addressed issues such as incorporating 
children's literature into lessons, developing themes that 
integrate language skills and content areas, and making the 
reading/ writing connection. A main focus of staff development 
activities during 1992-93 was exploring alternative assessment 
strategies, which included developing and piloting assessment 
materials. Follow-up assistance to teachers from CIMS-CA staff 
developers included demonstration lessons, individual and grade 
conferences, and classroom observations. 

In C,S,D. 11, where the project has been operating for four 
years I there were separate workshops for teachers based on the 
number of years they had participated in the Network, which 
focused on their interests and levels of experience with the 
whole language approach. The original group of W.L.N, teachers 
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in C.S.D. 11, now in their fourth year, met only twice dunnq t^e 
year instead of monthly, partly because of limited Network 
resources and also because staff developers felt this group was 
experienced enough to continue without as much support. 

Other professional development activities. During 1992-9 3, 
there were two professional development conferences for W.L.N, 
participants to further strengthen their understanding and 
application of — or, in the case of school administrators, their 
support for — the whole language approach. 

A four-day conference in summer 1992 focused on integrating 
whole language with math and science, and CIHS-CA staff 
developers from three of the district^ ^/orked collaboratively 
with CINS-Science and CINS-Math staff developers to plan the 
conference. (C.S.D.s 5 and 15 were not yet involved with the 
Network.) Teachers worked in grade-level groups to develop 
themes based on integrating math and science with a whole 
language approach. The conference also addressed alternative 
means of assessing progress in science and math. 

Another conference, in Hay 1993, focused on alternative 
assessment. Keynote speaker Roger Farr from Indiana addressed 
purposes and strategies of assessment, concentrating on the 
collection of materials for students' portfolios. Network 
teachers from all five districts attended the conference, as did 
some school supervisors and superintendents. Teachers developed 
and led a majority of the workshops. While stressing assessment 
issues, the conference also covered other whole language issues, 
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such as building and organizing libraries of children's 
literature and developing interdisciplinary themes* 

DRAMA COMPONENT 

The drama component has been in operation since the 1985*86 
school year. As in previous years, the goals of this component 
were to introduce students to the world of William Shakespeare, 
increase their understanding and appreciation of the theater, 
provide them with an opportunity to attend a professionally 
produced play, and encourage creative expression. Teachers of 
grades 4-8 in CIMS-CA schools could involve their students in 
this drama experience. 

The project consisted of three major parts: preparation for 
attending an off-Broadway performance of the play (this year^ 
Henry V for elementary grades and Lovers Labour Lost for junior 
high school), a trip to a live performance^ and students' 
performance of a selected scene. The fundamental approach 
entailed using drama to engage students actively in the learning 
process. Interactive, personal experience is thus viewed as a 
vehicle for extending their understanding of literature and 
developing communication skills. 

Teaching artists from the Theatre for a New Audience r whose 
services were contracted for through the central Board of 
Education, visited participating schools to conduct pre- and 
post*performance workshops directed at helping teachers to 
prepare their students, first for seeing the live production, and 
then for their own performances. This included model lesson 
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plans utilizing role play, improvisation, language gaaes^ and 
other teaching activities designed to help children becoM 
familiar with the content and historical background of the play, 
stimulate their imagination, and foster an appreciation for the 
power of language* Using abridged versions of the plays, 
teachers explored key themes, plot, characters, and Shakespeare's 
use of language with their students. Listening, speaking, 
writing, and appreciation of the play were emphasized* (Students 
were not expected to read the play.) Visiting artists also met 
with students to spark their interest in the play and to assist 
them in staging their selected scenes-*-"e«g. , developing their 
characters, interpreting their lines, and using appropriate 
movements and gestures. 

PROGRAM EV^LUATIQM 

The evaluation of the W.L.N, project by the Office of 
Research, Evaluation, and Assessment (OREA) focused on teachers' 
and staff developers' perceptions and assessment of the Network^ 
the support provided to participants, changes in teaching and 
assessment practices, and the effect of such changes on students' 
attitudes and achievement. 
Sample Selection 

For the qualitative portion of this evaluation, OREA 
included all teachers in C.S.D.s 3, 5, 11, 15, and 30 who were 
participating in the W.L.N, during the 1992-93 school year, as 
well as the CIHS*CA staff developers in each of these districts. 
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For thm quantitative portion of the evaluation, the spring 
.1993 reading scores of students in C.S.D.s 3, Hr and 30 whose 
teachers participated in the W.L.N, during 19S2-93 were compared 
with the test scores of students in the same grade levels whose 
teachers did not participate in the Network in order to assess 
the program's impact on students' reading achievement. (CS.D.s 5 
and 15 were not included because they were new to the project 
this year, and measureable changes in student reading achievement 
could not realistically be expected.) 
Data Sources 

The evaluation was based on the following data sources: 

• interviews with the central CIMS-CA project director and the 
coordinator of the W.L.N, project; 

• an interview with the CIMS-CA staff developer in each of the 
three districts participating in the project; 

• questionnaires mailed to all W.L.N, teacher participants 
covering such topics as the usefulness of the W.L.N, 
workshops, changes in teaching practices, approaches to 
assessment, and additional assistance needed; 

• rciview of relevant project documents; 

• site visits to several W.L.N, and drama workshops to learn 
more about the issues being explored and the concerns of 
project participants; and 

• a comparison of the spring 199 3 Degrees of Reading Power 
(D.R.P.) test scores of W.L.N, and non-W.L.N. students in 
CS.D.s 3, 11, and 30. 

SCOPE OF THIS REPORT 

This report of CREA's evaluation of the W.L.N, consists of 
four chapters. Chapter I provides an overall description of the 
project, focus of the evaluation, and evaluation methodology. 
Program implementation, including staff development activities, 
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participants' perceptions of various project components « and the 
impact of the W»L.N. on teaching practices and student attitudes 
and reading achievement are discussed in Chapter II. Chapter iii 
presents findings on students' achievement in reading. 
Conclusions and recommendations are included in Chapter IV. 
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II. PROGRAM IMPLEMENTATION 



DESCRIPTION OF RESPONDENTS 

A total of 77 teachers in the Whole Language Network 
(W.L.N.) returned the OREA questionnaire. This represented a 
response rate of 47 percent, considered good for a mailed survey. 
Slightly over one-third of the respondents were teachers of 
kindergarten through second grade, half taught third through 
sixth grade, and the rest taught more than one grade. Half of 
the respondents had been using CIMS*CA for two years or less, and 
only one«*third for more than three years. This was the first 
year of participation in the W.L.N, for about 40 percent of the 
teachers, while less than one-fourth had been involved with it 
for mores than two years. 

gVRRICVLVM AND CIASSRQQM ACTIVITIES 

Responding teachers reported that they used children's 
literature for several important purposes in their classrooms. 
Most important, according to one*third of the respondents, was to 
help cultivate oral and written communication skills. One 
teacher explained that it was crucial to "develop in students the 
need to communicate t to find their voices as speakers, thinkers, 
authors, readers, and Listeners." Literature also fosters a love 
for reading and an appreciation of the beauty of language. Other 
related purposes cited by teachers included: learning specific 
skills involved In reading, writing, listening, and thinking 
critically; listening to and understanding others' points of 
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view; and expressing feelings clearly. Several teachers 
discussed the importance of connecting literature and language to 
other areas of life, by relating personal experiences to what 
students read and shoving them that reading and writing are 
skills needed throughout life* Several teachers also asserted 
that language arts form the basis for all other curriculum areaa. 
Teachers also discussed the use of children's literature 
specifically as the basis for all language and communication work 
in their classrooms. Many (N»26) reported that they ustd 
literature as the foundation for themes that integrated dlffeieht 
curriculum areas, particularly social studies, but also Bcitttue, 
math, art, and music. 

Responding teachers indicated that the Network had bseii 
valuable in helping them implement instructional ■tiaisqiea 
integral to the whole language approach. As Table I Ihci i&?atpii , 
nearly all respondents (98 percent) found it moderataly or vi^m y 
useful for incorporating children's literature and making the 
reading/ writing connection* At least 90 percent of W.L.N, 
participants found the Network useful for encouraging pruusaii 
writing, using multicultural themes, developing interdisciplinary 
themes p encouraging cooperative learning, and Integrating 
content-area materials. A large majority found it useful in 
exploring trends in alternative asseesment* A greater 
percentage of respondents found the Network useful in each of 
these categories than respondents in the 1991-92 schovol year had, 
langlng from Increases of four percent for incorporating 



Table 1 



Percentage of Teachers Considering the Whole 
Language Network Useful for Various Purpoaee 







Rating 




Purpose 


Very 
Useful 


Moderately 
Useful 


Combined 


Incorporating children's 
1 iterature 


90 


o 
o 


Q O 


Making the reading/ 
writing connect ion 


75 


23 


Ofl 


Encouraging proceaa 
writing 


67 




96 


Using multicultural 
themes 


66 


26 


92 


Developing intardisciplin 
ary themes 


54 


38 


92 


Encouraging cooperative 
learning 


5S 


36 


91 


Integrating content-area 
materials 


65 


25 


90 


Exploring alternative 
assessment trends 


44 


44 


88 



Large najorities of teachers (ranging from 88 to 98 
percent) considered the Whole Language Network useful 
for the purposes intended. 



children's literature^ making the reading /writing connection, and 
integrating content-area materials, to an increase of 13 percent 
for teaching process writing. 

Teachers identified a number of strategies they used in 
teaching language arts* All respondents said they read aloud to 
children and conducted whole group discussions. Nearly all (96 
percent) had children read aloud to them and modeled the steps in 
the writing process for children* Only 57 percent r on the other 
hand, used reading skills worksheets with their classes. A 
majority of respondents also named other strategies they used, 
including journal writing, making books, doing art projects 
relating to language work^ and using poetry and songs. 

Asked what kinds of interactive activities their students 
engaged in, over 90 percent of teachers named shared reading or 
writing in whole class or small groups, and sharing their own 
work with others in the class. Over 80 percent said their class 
had literature discussion groups, two-thirds used peer tutoring, 
and three-fifths said their students edited each other's work* 
In addition, teachers said their students interacted in creating 
original plays, art projects, and making their own books. 

Teachers also identified several ways in which their 
students assximed responsibility for their own work* Nearly all 
said that students chose books and other materials for their 
reading, and selected topics they wanted to write about. 
Three-fourths said their students made decisions about their 
independent work or group projects, and slightly less than half 
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raporttd that thslr students assessed or reflected on their own 
progress* 

As discussed in Chapter I / one focus of staff development 
activities during the 1992-93 school year was alternative 
assessment. Staff developers from all five school districts 
reported that they devoted time at monthly Network meetings to 
exploring different types of alternative assessment and, in some 
cases, developing checklists or forms for assessing student 
progress in language arts. In some districts, teachers piloted 
assessment techniques with students and discussed them at Network 
meetings, while in others the staff developers introduced the 
concept of alternative assessment with the intention of having 
teachers begin to implement them during the 1993-94 school year. 
In one district, teachers created their own assessment form, 
practiced using it, and planned to pass it on to their students' 
teachers next year. In another district, teachers practiced 
interviewing students about their reading* In two other 
districts, according to staff developers, teachers worked on 
developing student portfolios. 

Teachers said they used a variety of techniques to assess 
student achievement in language arts. Nearly all (96 percent) 
used observations of student performance. For nearly 
four-fifths, conferences with individual students and student 
contributions to group projects were factors in assessment. 
Nearly two-thirds reported using student portfolios* Fewer 
respondents used teacher*made tests (44 percent) and standardized 
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tests (33 percent) . A few teachers mentioned other sources for 
assessment, such as student journals, response logs, artwork 
connected to language projects, oral reading, and skills sheets. 

Eleven responding W.L.N, teachers participated in the 
Shakespeare component of CIMS-CA. All of them found the related 
activities useful, including the pre-play workshops to prepare 
for viewing the play, the post-play workshops and the artists' 
classroom visits to help children prepare for their own 
performance. All of the teachers said that the experience was 
valuable for their students. Banefits to children Included an 
increased understanding and appreciation of Shaksvpeare, and the 
opportunity to work together to produce a scene and perform it. 
One teacher exclaimed, **Ny students were thrilled by the 
experience. It had a tremendous impact on their self '^•percept ion 
and how others saw them." Another said it was "the best thing I 
have ever done with kids and they have become lovers of 
Shakespeare and theater." Teachers also described the experience 
as valuable because they were able to connect it to other areas 
of the curriculum such as art, music, history, reading, writing 
and use of language in general. 

gyPPQRT AND TRAINiyg 

CIMS-CA staff developers in the five districts provided 
support to teachers in the W.L.N. , in the form of monthly 
workshops, in-school assistance, and conferences in summer 1992 
and May 1993. 
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staff developers described a variety of responsibilities 
they assumed for the monthly workshops, which included planning 
the meetings, ordering materials, working with school 
administrators to make sure teachers were released from teaching 
duties (if the meetings were held during school time) , selecting 
materials for distribution, and preparing themselves by reading 
professional articles. They described their role at the meetings 
primarily as facilitators, empowering teachers to share ideas and 
children's work, communicate their classroom experiences, lead 
discussions, or read aloud to the group. According to staff 
developers, these meetings gave teachers an opportunity to 
network with their peers, learn about whole language materials 
and approaches, and plan for the future. Most respondents (87 
percent) found the meetings valuable in helping them apply the 
whole language approach in their classrooms. 

Staff developers^ responsibilities for the summer 1992 and 
spring 1993 conferences included planning the agenda in 
collaboration with CIMS-Science and CIMS-Hath staff, recruiting 
participants, encouraging Network teachers to lead workshops and 
assisting them in preparing presentations, arranging schedules 
and rooms assignments, facilitating at workshops, and preparing 
bibliographies and other materials for participants. 

Almost half of the responding teachers attended the summer 
1992 conference, and approximately the same number attended the 
May 1993 conference. A large majority of attendees (81 and 78 



percent, respectively) judged these staff development activities 
to be valuable. 

Staff developers in each district reported spending much of 
their time working in schools with Network teachers. They 
conferred with teachers about setting up libraries, delivered 
materials, worked with paraprof essionals, and visited classrooms 
to observe, conduct model lessons, and read aloud to students. 
Outside of the classroom, they met with teachers to plan 
activities during preparation periods, sometimes conducted grade 
conferences attended by other school staff as well as Network 
teachers, and acted as liaisons to school administrators in 
planning for the Network. 

Nearly all responding teachers (92 percent) rated the 
assistance provided by CIMS-CA staff developers as helpful 
(referring to all of their assistance, in school and at 
meetings), while most of the rest (6 percent) said this help was 
not needed. Sample comments by teachers give a sense of the 
importance of the staff developers to the Network: 

• She is a treasure* She is always available to offer 
assistance or encouragement in any way she can. 

• He was always available for demonstration lessons or 
individual conferencing. 

• Her dedication to her group of network teachers was 
renarkable^ giving us a wealth of materials, preparing 
pertinent agendas. 

About half of the respondents indicated that their own 
school provided a staff developer, and the majority of these 
teachers (63 percent) regarded this assistance as helpful. Also, 
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most responding teachers (80 percent) believed that their 
colleagues were a valuable source of assistance. Teachers 
considered monthly W.L.N, meetings and the two conferences as the 
most valuable training activities in helping them to apply the 
whole language approach in their classroom. Other activities 
considered worthwhile, although by fewer teachers, were 
individual conferences (43 percent) , classroom observations (42 
percent) I and grade conferences (20 percent). Other training 
activities mentioned as worthwhile included observing other 
teachers I courses or workshops taken on their own (mostly with 
the Writing Project at Teachers College), and visits to their 
classroom by authors. 

When asked how their principals supported the implementa- 
tion of the whole language approach during the year, a majority 
of teachers reported that school administrators had provided 
release time for staff development activities (62 percent) and 
encouraged the purchase of appropriate materials (56 percent). 
Fewer respondents said that principals had provided planning time 
to collaborate with peers (43 percent), or provided such direct 
instructional assistance as observations and individual or group 
conferances (30 percent). Some W.L.N, teachers asserted that 
their principals strongly believed in the whole language 
approach, and generally supported their use of whole language 
ideas and methods, such as process writing. According to 17 
percent of the respondents, however, principals provided little 
or no support. Less than half of the responding teachers (47 
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percent) rated the assistance provided by school Bupervisors, 
overall, as helpful; about one-fourth said that such help was not 

provided. 

IMPACT OF THE W.L.N. 

changgg in Teaching 

Nearly all respondents described positive changes in their 
teaching practices that they attributed to participation in the 
w.L»N. Some sample comments reflect the uplifting effects of the 
Network: 

• I have grown so much as a teacher by being involved with the 
W.L.N. ! 

• It has enriched and enhanced my ideas in the classroom. I'm 
reborn! 

• I am not the same teacher I was. 

• I have thoroughly enjoyed it and it has renewed my spirit. 
In describing the ways in which their teaching had been 

enhanced, some teachers commented on their increased familiarity 
with the whole language approach and how to implement it. These 
teachers reported that their understanding of the whole language 
approach, their awareness of appropriate materials, and their 
knowledge about children's literature, for example, had Increased 
during the year* 

Other teachers referred to specific changes in their 
teaching practices-*mo8t notably, less reliance on basal readers 
and workbooks, and increased use of literature for students' 
reading* Some cited greater use of group work and projects, 
increased «imphasis on vocabulary, the integration of subject 
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areas, and time spent both reading aloud to students and 
listening to them read. One teacher commented that the Network 
had "provided me with activities that encourage reading and 
writing in a natural, developmental way." Another described her 
teaching now as "much more geared to small group and individu- 
alized instruction. The classroom, in general, is more child- 
centered than before." 

Another change that was important to many teachers concGrned 
their relationship with colleagues. To many teachers, a main 
benefit they derived from the Network was the opportunity to talk 
to, and learn from, their peers. The time provided for staff 
development meetings furnished both information and support. 
Teachers' comments describe the impact of this change: 

• The sharing of ideas at the meetings has helped me change 
practices in my classroom. 

• I think that teachers need to talk to one another to find 
out what is going on. 

• I have learned many strategies from my fellow teachers. 

• The Network gives you the opportunity to share with your 
peers. I have experimented with methods and ideas used by 
others. 

Teachers also reflected on changes in their own attitudes 
toward teaching. They described themselves as more open to new 
ideas, more flexible in their approach to teaching, more willing 
to take risks, more creative, more reflective, and more 
experimental in their choice and use of instructional materials. 
Teachers attributed these changes to the support and attitude of 
CIMS--CA staff developers and the opportunities for discussion and 
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reflection at staff development meetings. The net result of 
these changes r according to many teachers, was an increased 
enthusiasa for teaching. 

Staff developers' perceptions corroborated teachers' views 
of positive changes in their teaching. Staff developers noticed 
increased and improved use of literature, more interdisciplinary 
curriculum, and a greater degree of comfort and confidence in the 
whole language approach « 

k majority of respondents (57 percent) also reported that 
participation in the W.L.N. h«d « positive Influence on their 
involvement in curriculum planning. These teachers explained 
that they had become more Knowledgeable about curriculum, 
materials I and literature through Network activities i and 
consequently now chose what their students read instead of 
relying on basal readers. Many teachers also created curriculum 
projects or themes during the year, such as a theme on families 
and one on different cultures. Several teachers reported that 
they had developed projects collaboratively with other teachers, 
either at Netvork meetings or^ in some cases i in school. Not all 
teachers were involved in making curriculum decisionsi however. 
A few indicated that school principals were opposed to teacher 
involvement in curriculum decision making. 

A large majority (78 percent) of teachers indicated that 
their participation in the W.L.M. led to greater professional 
satisfaction. The reasons they cited echoed their perceptions of 
changes in their teaching practices and involvement with 
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curriculum decisions. Learning about teaching through th« 
Network was gratifying in itself. Teachers said they had en ;cyGi 
l«arning about whole language as well as other curriculum areas, 
and becoming more knowledgeable about children's learning and 
development. One teacher said the Network had precipitated 
"great discoveries about children's talents and thoughts." 

Another source of teachers' satisfaction was their students' 
heightened enthusiasm for reading: 

• Seeing the children enjoy books has made me happier in my 
profession. 

• I enjoy seeing my class excited over who takes home a book 
tonightl 

• The children enjoy reading and listening to stories. That's 
made me feel good. 

• I feel more fulfilled when the enthusiasm of the children is 
felt. 

• I find that the children become so enthusiastic, and I, in 
turn, get enthusiastic, and on and on! 

Many teachers weris pleased about their own professional 
growth, and viewed themselves as better at teaching language, 
using literature effectively, developing themes, implementing the 
writing process, and using whole language teaching in general. 

Teachers also derived satisfaction from networking with 
colleaguss. As one teacher put it, **My professional satisfaction 
has been enhanced by the opportunity to meet with like-minded 
colleagues who put their whole language philosophy into practice. 
I would like to see this type of networking given time and 
professional support grade-wide in every school." 




Altogether, teachers expressed a sense of contentment and 
excitement in being part of the W.L.N, a few comments are 
illustrative of this sentiment: 

• I don't know what I would have done as a new teacher without 
CIMS-CA and my district staff developer. 

• I have grown a lot. 

• I'm feeling more changed up and inspired. For the first 
time in 15 years I feel that the treatment we received from 
the district staff developer and others in the W.L.N, is 
more professional than I've yet experienced. 

• It makes me want to come to work! I enjoy teaching this 
wayl 

Perceived Changes in Student Attitudes and Learning 

Host respondents (83 percent) perceived positive changes in 
students' attitudes toward learning and school. This change 
manifested itself, according to teachers, largely in the area of 
reading. These teachers believed that their students loved 
books, had a desire to read more and to read different types of 
books, and had a greater appreciation of literature, because of 
the whole language approach. They now enjoyed reading for 
pleasure and looked forward to new books. This attitude was also 
associated with an increased interest in writing their own books. 
Teachers also observed differences in students' general attitudes 
toward learning. Many teachers said that their students now had 
more confidence in their abilities, took more responsibility for 
their own learning, were more involved in their work, and enjoyed 
working cooperatively with their peers. One teacher atl;ributed 
these changed attitudes to **a non*threatening, risk-free 
environment" in which leekrning had become fun and exciting. 
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Othar taachars associatsd chanqsfl mor« gAharaUy with tha 
environment of thair whole languaqa c::lassrQomB . A few comments 
capture the flavor of thta anvtronmanti 

• My students consider every day a new adventure 1 They beg 
for writing center and enjoy all aspects of the language 
program. Most of my kindergarten students are emergent 

readers. 

e Students enjoy reading trade books more than the basal 
reader. The skills are taught in a way that the children 
are more active participants in their learning. 

e My students love to read and write. They can't get enough 
books to read, and they are constantly writing I 

Most teachers (68 percent) related their participation in 

the W.L.N, to improvements in student achievement, although the 

rest were unsure or did not comment. Many teachers named 

specific areas of improvement, such as reading and writing 

skills, thinking skills, vocabulary, and language arts skills in 

general. Many of those who did not attribute these gains 

directly to the whole language approach, nevertheless alluded to 

such a connection: 

• My students have made nice progress in reading because many 
have developed a real love for books. 

• The materials used build in their own success I Literature- 
based programs workt My students are excited about taking 
command of their reading and writing! Come and visit 

any timet 

• The amount of material and information the children retained 
increased dramatically. They were able to carry their 
knowledge into all other areas. 

• My third graders are reading above grade level and are 

writing, writing, writing! 



ADDITIONAL SUPPORT AND CHANGES NEEDED 

Many teachers identified areas in which they felt additicnai 
support was needed. Foremost among these was the need for 
funding for additional materials such as writing supplies and 
trade books. They also asked for more time to meet and plan with 
colleagues, attend conferences, collect materials, and work on 
themes. Several teachers expressed the desire to visit 
classrooms of other teachers using the whole language approach. 
Some teachers wished that the principals and supervisors in their 
schools were more supportive of the whole language approach and 
their efforts to implement it, A few teachers requested more 
information and workshops on specific topics with which they 
needed help, such as cooperative learning and working with small 
groups. Finally, in CS.D. 11, where teachers in their fourth 
year with the Network did not meet monthly in 1992-^? as in 
previous years, some respondents expressed the need to continue 
these regular meetings. 

Staff developers also identified some of the same needs 
teachers did. From their perspective, the most pressing need was 
for greater support from school administrators: to understand the 
whole language approach; to support whole language teachers; to 
be involved in training sessions; and to ensure released time for 
training activities. Staff developers reiterated teachers' 
desire for additional meeting time and for more funding for 
materials. They also expressed the hope that the Network could 
be expanded to include more teachers, and that districts would 



agree to cluster more Network teachers in fewer schools. Th«y 
believed that in this way teachers would be able to offer one 
another greater support and would feel less isolated. 
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III. STUDENT ACHIEVEMENT 



In order to assess the impact of the W.L.N, on students' 
reading achievement, OREA compared the spring 199 3 mean scores on 
the Degrees of Reading Power (D.R.P.) test of students in grades 
2-6 in the sample districts (C.S.D.s 3, 11, and 30) whose 
teachers participated in the Network during the 1992-93 school 
year with the mean scores of all other students (non-W.L.N.) in 
these districts. 

Scores are reported in the form of Normal Curve Equivalents 
(N.C.E.s), norm-referenced scores which indicate how students 
performed in relation to a national norming sample— i.e., 
students in the same grade in a nationally representative sample 
who took the test. Since N»C»E.8 are based on an equal interval 
scale, they can be used for arithmetic and statistical 
calculations, and to compare scores across grade levels. 

Uncorrelated ^--tests were conducted to determine the 
statistical significance between the scores of W.L.N, and non- 
W.L.N, students, and an effect sizwe (E.S.) calculated to 
determine whether any differences obtained were educationally 
meaningful.* 

*The effect size is the ratio of the mean gain to the standard 
deviation of the gain. This ratio provides an index of the 
improvement in standard deviation units irrespective of the size 
of the sample. An E.S. of 0.2 is considered to be a small E.r^., 
0.5 a moderate E.S., and 0.8 a large E.S. Only effect sizes of 
0.8 and above art considered to be educationally meaningful, 
reflecting the importance of the change to the students' 
educational development. 
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As can be seen in Tables 2-'6, the mean differences in tne 
spring 1993 D.R.P. scores of W.L.N, and non-W.L.N. students in 
the sample districts were too small to be considered 
educationally meaningful, although in C.S.D.s 11 and 30 there was 
a tendency for the scores of W.L.N, students to be higher than 
those of non-W.L.K. students. In C.S.D. 3 this trend was 
reversed. 

However, caution should be exercised in interpreting these 
findings. While standardized reading tests (such as the D.R.P.) 
provide useful information about student achievement and allow 
for comparisons based on uniform testing conditions and objective 
scoring standards, they are limited. They provide evidence of 
student performance at a given moment in time (typically under 
stressful conditions) and^ since they are multiple choice in 
nature^ require a single **riqht'* answer that does not reveal 
students' reasoning processes. Consequently, standardized test 
data should be supplemented with other sources of evidence of 
reading competency , including those that sample student 
performance over an extended period of time, require 
explanations, interpretations, and reactions to written text, 
make use of a variety of reading contexts, and present tasks that 
are meaningful for students. 
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Table 2 

Comparison of Spring 1993 D.R.P. Scores (N.C.E.s) of 
W.L.N, students and Non-W,L.N. Students 
in Selected W.L.N. Districts by Grade 



Grade 




w,L,N, 






Non-W.L.N. 


Difference 


E.S. 


N 


M«an 


S.D. 


N 


Mean 


S.D. 


Mean 


2 


555 


48 . 0 


23 . 3 


5, 734 


45.4 


22.6 


2.6 


0. 1 


3 


370 


51.1 


24.6 


6, 328 


43.7 


23.4 


7.4 


0.3 


4 


407 


52.7 


26.2 


6, 302 


48.1 


24.4 


4.6 


0.2 


5 


505 


52.3 


21.3 


6, 203 


49.5 


22 .8 


2.8 


0.1 


6 


88 


21.4 


60.0 


4,667 


46.4 


23.1 


13.6 


0.6 


Total 


1,925 


51.3 


23.7 


29,234 


46.7 


23.4 


4.6 


0.2 



Overall, the mean scores of W.L.N, students on the 
spring 1993 D.R.P. were higher than the mean scores of 
non-W.L.N. students for all grade levels in the sample 
districts. However, the differences were too small to 
be considered educationally meaningful. 
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Table 3 



Comparison of Spring 1993 D.R.P, ScoraB (N.C.E.s) of 
W.L.H. and Non-W.L.N. Students in Selected 
W.L.N. Districts by District 



W.L.N, 

C.S.D. N Mean S.D. 



Non-W.L.N. Difference 

N Mean S.D. Mean E.S. 



44.7 


25. 3 


-7.0 


0.3 


44.8 


22.7 


5.0 


0.2 


49.6 


22.9 


8.6 


0.4 


46.7 


23.4 


4.6 


0.2 



3 


358 


37. 7 


22.5 


5,529 


11 


712 


49.8 


23. 3 


12,293 


30 


855 


58.2 


21.9 


11,412 



Total 1,925 51.3 23.7 29,234 



• In all sample districts, the mean differences between 
the scores of W.L.N students and non-*W.L.N. students on 
the spring 1993 D.R.P. were too small to be considered 
educationally meaningful. However, in CS.D.s li and 
30, there was a tendency for the mean scores of W.L.N 
students to be higher than those of non-*W.L.N. 
students, whereas in C.S.D. 3 this pattern was 
reversed. 
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Table 4 



Comparison of Spring 1993 D.R.P. Scoros (M.O.B.s) of 
W.L.N, and Non-W.L.N. students in C.S.D. 3 by Grade' 



w-LrWt y<?n-w,L,Wt Pifffercnce 

Grade N Mean S.O. N Mean S.D. Mean E.S. 



2 


124 


37.7 


22.8 


1,353 


44.0 


25.0 


-6.3 


0.2 


3 


108 


40.2 


21.3 


1,454 


43. 1 


24.9 


-3.1 


0.1 


4 


46 


31.1 


24.5 


1,339 


45.5 


26.5 


-14.4 


0.5 


5 


80 


38.0 


22.3 


1,383 


46.2 


24.5 


-8.2 


0.3 


>tal 


3S8 


37.7 


22.5 


5,529 


44.7 


25.3 


-7.0 


0.3 



" These analyses do not Include the scores of grade 6 students 
because in C.S.D. 3 teachers of this grade level did not 
participate in the W.L.N. 



• Overall, the spring 1^93 D.R.P. mean scores of w.L.N. 
students were lowe^ than the mean scores of non-^W.L.N. 
students in C.S*D. 3, although these differences were 
too small to be considered educationally meaningful. 



30 

4 ) 



Table 5 



Compariflon of spring 1993 D.R.P. scoras (N.c.E.s) of 
W.L.N, and Non-W.L.N. Students in C.S.D. 11 by Grade 



W>L.N. Non-W.L.N. Difference 



Grade N Hean S.D. N Mean S.D. Mean E.S. 

2 276 47. B 23.5 2,350 41.7 21.9 6.1 0,3 

3 35 52.3 21.5 2,387 41.7 22.5 10.6 0,5 

4 178 44.4 26.0 2,589 46.5 23.6 -2.1 0,1 

5 209 56.9 19.6 2,548 49.5 21.8 7.4 0,3 

6 14 48.5 12.7 2,419 44.3 22.6 4.2 0.2 

Total 712 49.8 23.3 12,293 44.8 22.7 5.0 0.2 



* overall, the spring 1993 D.R.P. mean ecores of W.L.N, 
students tended to be higher than the mean scores of 
non-W.L.N. students in C.S.D. 11, although these 
differences were too small to be coneidered 
educationally meaningful. 
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Table 6 



Conparison of Spring 1993 D.R.P. Scoras (N.C.E.a) of 
W.L.N, and Non-W.L.N. Studants in C.S.D. 3 0 by Grada 







W.L.N. 






Mqo-w.j^n. 


Difference 


Grade 


N 


Maan 


S.O. 


N 


Mean 


S.D. 


Mean 


E.5. 


2 


155 


56.7 


19.6 


2,031 


50. 7 


20.6 


6.0 


0.3 


3 


227 


56. 1 


24.9 


2,487 


46. 1 


23.2 


10.0 


0.4 


4 


183 


66.2 


19.0 


2, 374 


51.4 


23.6 


14.8 


0.6 


5 


216 


53.1 


20.3 


2,272 


51. 5 


22.7 


1.6 


0.1 


6 


74 


62.2 


22.0 


2,248 


48. 7 


23.4 


13.5 


0.6 


Total 


855 


58.2 


21.9 


11,412 


49. 6 


22.9 


8.6 


0.4 



• overall, the spring 1993 mean D.R.P. scores of W.L.N, 
students were higher than those of non-W.L.N students 
in C.S.D. 30, although these differences were too small 
to be considered educationally meaningful. 
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IV, CONCLUSIONS AND RECOMMENDATIONS 



Tho findings of this evaluation indicate teachers who 
participated in the Whole Language Network were overwhelninqly 
satisfied with the support they received from staff developers, 
with the training activities in which they took part, and with 
their own professional growth in understanding and implementing 
the whole language approach in their classrooms. Compared with 
the OREA evaluation of the W«L«N. in the 1991-92 school year, 
teachers were even more positive about their experience. 

Teachers were most enthusiastic about the support given to 
them by CINS-CA staff developers who, as in previous years, 
offered various kinds of assistance. Teachers greatly 
appreciated the monthly meetings in which they had the 
opportunity to communicate with their peers in the Network. They 
also praised staff developers for the in-school support they 
offered, including modeling lessons, helping them plan, and 
providing materials. Finally, teachers who participated in the 
summer 1992 and May 1993 conferences found these to be very 
helpful. The eleven teachers who participated in the Shakespeare 
component all lauded the experience for contributing to their 
students' language development and appreciation of theater. They 
also thought the opportunity to prepare and present a scene from 
the play was a valuable experience for their students. These 
teachers are rated the training, including the pre- and post-play 
workshops and the artists' visits, very highly. 



A main focus of the May 1993 conforanco was explorinq 
alternative means of assessment, and staff developers reported 
addressing this throughout the year as well* Nearly 90 percent 
of respondents indicated that the Network had been valuable in 
helping them learn about various alternative assessment 
strategies. Staff developers in all five districts reported 
discussing this issue in monthly meetings, and in some districts 
teachers created and piloted forms or checklists for assessing 
students' language skills. Exploring alternative assessment 
techniques was more systematic than in the previous year in that 
training activities focused on it and staff developers worked 
with teachers to help them experiment with different techniques. 
Some staff developers indicated that this year's efforts were 
directed at helping teachers to understand the conept of 
alternative assessment, and th?it next year's focus would be on 
implementation. 

In addition to the assistance they received from staff 
developers, teachers reported receiving a great deal of support 
from their colleagues, both in school (where more than one 
Network teacher was in the same school) and at Network staff 
development activities. They benefited from hearing from 
colleagues talk about their classroom experiences, planning 
themes and other curriculum activities collaboratively, and 
discussing common concerns* 

Compared with the previous year, a slightly higher 
percentage of teachers, although still a minority, was satisfied 
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with tha assistance and support provided them by school 
supervisors. At the same time, many teachers and staff 
developers wished that school administrators understood , 
supported, and were involved with the whole language approach to 
a greater extent. 

Nearly all teachers believed that they were better teachers 
and were more satisfied professionally because of their 
involvement with the W.L.N. Their level of knowledge about whole 
language had increased, as had their ability to implement whole 
language practices* As a result of these changes, their attitude 
toward teaching had improved. They saw themselves as more 
confident of their abilities and more enthusiastic about 
teaching. Most teachers also reported that they were more 
involved in making curriculum decisions than before, although 
some said that their supervisors/principals? would not allow them 
to be involved in this. 

A large majority of respondents believed that as a 
consequence of the positive changes in their own teaching, 
children's attitudes and achievement had improved. They saw 
their students as better and more enthusiastic readers and 
writers, more confident about and involved in their own learning, 
and more collaborative workers. 

In spite of their successes and overall satisfaction with 
the W.L.Nw teachers and staff developers identified several 
areas in which they needed additional support: greater support 
from school administrators; a higher level of financial support 
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for materials; and additional time for planning ^ network inq. and 
visiting other whole language classrooms. 

Overall, the mean differences in the spring 199 3 D.R.P. 
scores of W.L.N, and non-W.L.N. students in the sample districts 
were too small to be considered educationally meaningful, 
although in C.S.D.s 11 and 30 there was a tendency for the scores 
of W.L.N, students to be higher than those of non-W.L.N. 
students. In C.S.D. 3 this trend was reversed. 

Based on the evaluation findings, OREA makes the following 
recommendat ions : 

• CINS-CA staff developers should continue to educate Network 
teachers about alternative assessment strategies, and assist 
them in implementing these techniques in whole language 
classrooms. These should include the use the language in 
meaningful contexts, demonstrations of competence with a 
variety of genres, and opportunities for students both to 
demonstrate and reflect on their own progress over time. 

• Given the success the W.L.N, has experienced, CIMS-CA 
program staff should endeavor to expand the number of 
districts and teachers involved in it and, to the extent 
possible, concentrate a larger number of participating 
teachers, and teachers of contiguous grades, in the same 
schools. This would provide teachers with greater sources 
of support and students with greater instructional 
continuity. 

• In view of the importance of principals' support in 
integrating whole language strategies into classroom 
practice, project staff should continue to explore ways of 
securing their interest and active participation. 

• Project staff should continue to explore ways of obtaining 
books and other materials necessary to the whole language 
approach, including private donations; strategies for 
sharing needed materials, such as district bookmobiles, 
might be considered as well. 



Together with school and district administrators, W.L.N, 
staff should explore ways to provide Network teachers wi 
more time to meet together and to participate in staff 
development activities, both during and after the school 
day. 



